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ABSTRACT 

Fifteen research reviews pertain to vocational 
education accreditation and evaluation organized under these topics; 
(1) Accreditation, discussing curriculums in postsecondary 
institutions, (2) Program Evaluation, in vocational agriculture, 
business education, manpower training, and trade and industrial 
education, (3) Local Evaluations, repurting a cost-effectiveness 
study, evaluation systems, and a program analysis questionnaires, and 
(4) other Studies, relating the role of the teacher, a system for 
state evaluation, industry-education advisory committees, and student 
teaching in home economics. '’Plain Talk" discusses research synthesis 
and interpretation to the profession. In addition to the studies 
reported in this issue, 40 additional bibliographic citations on the 
topic are included. (DM) 
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Evaluation and the advisory process 
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The professional quip which is 
frequently overheard these days, 
“What is needed in evaluation is 
more evaluation on evaluation,” 
despite its tail-chasing nature is not 
without strong merit. Periodically, 
Research Visibliity has reported re- 
search and development activities of 
this nature. (See May 1968 and 
May 1969 issues.) This month, RV 
once again reports on the subject of 
evaluation with deliberate twist of 
implications of the evaluative process 
for advisory committees and coun- 
cils — more broadly the cooperation 
of industry and education in ap- 
praisal. Relatively few studies high- 
light these advisory implications; in 
exercising its synthesis prerogative, 
RV holds up as exemplary a few 
efforts of this nature. 

Accreditation— formalizing the evalua- 
tive process. The topic and activity in 
accreditation, at least as its appears 
(or fails to appear) in research liter- 
ature, almost go by default. This is 
not to say that there is nothing afoot 
in accreditation. Far from it! One of 
the most encouraging new ventures 
to shape up in recent months is the 
AVA’s project (with cooperation of 
the Office of Education and high- 
lev^U involvement of numerous 
groups and agencies), National 
Study for Accreditation of Vocation- 
al-Technical Education. 

This study will go forth in the 
context of research and develop- 
ment, and certainly not in the sense 
of creating an AVA accrediting 
agency or accreditor. To those who 
are even vaguely familiar with the 
monumental problems of vocational 
accreditation, the effort is imperative 
and long overdue. 

The project is especially fortunate 
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to have as its director, Lane C. Ash, 
former assistant director of the Divi- 
sion of Vocational and Technical 
Education of the Office of Education 
in Washington, D. C. As a life-long 
vocationalist with experience on 
many levels, Mr. Ash needs no intro- 
duction .to professionals or programs. 
Inasmuch as the AVA project em- 
braces all aspects of accreditation in 
all types of programs of vocational 
and technical education, the RV 
readership should be sensitive to its 
operation and importance, and take 
the necessary initiative to make its 
input. Details of the project should 
be requested from Mr. Ash at AVA 
headquarters. 

Place of advice-giving in evaluation. 

Regardless of the extent to which 
advisory groups of many natures have 
been involved over the years in vo- 
cational education on all levels, the 
die is cast for their current role and 
that of the future. This fact is implic- 
it in the general spirit of current 
legislation on many fronts; it is ex- 
plicit in vocational education legisla- 
tion. The prescription is not palat- 
able to many administrators, moreso 
it is downright threatening to others. 

Nonetheless, and in deference to 
professional opinion, the advice- 
seeking and advice-giving are here 
with more than a little degree of 
finality. One interpretation indicates 
that the advisory has become admin- 
istrative and hence spills over into 
the making of policy. On the other 
hand, there is little escape from the 
professional question, “Why is the 
advisory counsel stipulated in law 
and regulation?” Professionals in ev- 
ery function ,and on every level of 
vocational and technical education 
can afford more than speculation 



with their answers. 

In this month’s report, at least 
three investigators (Samuel Burt, 
Harold Byram and the Rhode Island 
Staff) make distinctive efforts to em- 
ploy the advisory function in ap- 
praisal. Many of the other studies 
report implications of involvement 
and various advantages of including 
advisory groups, at least on a team 
basis. No doubt, Samuel Burt, of the 
W. E. Upjohn Institute for Employ- 
ment Research, is the ardent advo- 
cate of the industry-education coop- 
eration theme. RV readers with spe- 
cial interests in this topic should re- 
quest additional materials of Mr, 
Burt at the Institute, 1101-17th St., 
N.W,. Washington, D.C. 20036. Mr. 
Burt’s ideas go far beyond the realm 
of theory as a result of his experi- 
ences and field testing in several of 
the States. 

As a prelude to serious thought 
and professional activity in accredi- 
tation, careful review should be 
made of the Messersmith and Med- 
sker study which is briefly abstracted 
this month. Basic problems and is- 
sues are examined, the role of the 
professional association is explored, 
and data from a survey of agencies 
approved by the National Commis- 
sion on Accrediting are given. 

Not unlike the formalization of 
the role of advisory groups in voca- 
tional education programs, evalua- 
tion for accreditation purposes will 
persist, become more pronounced 
and eventually generate clout on the 
teaching, coordination, administra- 
tion, guidance and counseling, curric- 
ulum, research, and other aspects of 
the vocational and technical pro-1 
gram. The clout will not miss thel 
advisory process. ] 
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See Bibliography for Information 
on availability of complete studies 




Topic One: ACCREDITATION 



Curricula in Postsecondary Institutions 



Problems and Issues in Accreditation by 
Specialized Agencies of Vocational-Tech- 
nical Curricula in Postsecondary Institu- 
tions. Lloyd E. Messersmith and Leland 
L. Medsker, The Center for Research and 
Development in Higher Education. Uni- 
versity of California, Berkeley. 1969. 

The increasing number of postsec- 
ondary institutions providing voca- 
tional-technical courses leading di- 
rectly to employment in the past few 
years has created problems relating 
to the accreditation of these institu- 
tions. Although the National Com- 
mission on Accrediting was estab- 
lished in 1949, little attention was 
given to the accreditation of voca- 
tional institutions, and professional 
associations have therefore begun to 
concern themselves with this function. 

Problems arising from these activi- 
ties are reflected in questions at- 
tacked by this study: 

1. To what extent are specialized 
agencies now approving curricula in 
two-year colleges? 

2. Is there evidence that special- 
ized accreditation either inhibits or 
promotes the development of occu- 
pational programs? 

3. Does the specialized agency 
have concerns related to standards 
and the level of training given by 
institutions? 

For purposes of the study, materi- 
als were collected which described 
activities of accrediting agencies, leg- 
islation on the subject was reviewed, 
interviews were conducted, and 
questionnaires were developed and 
administered. The survey covered 43 
two-year institutions, 5 professional 
associations and 6 regional associa- 
tions. 

Recent history and current status 
of specialized accreditation are de- 
lineated by the report in order to 
view the problems associated with 
this accrediting activity in the proper 
framework. Starting with a 1961 re- 
quest by the American Association 
of Junior Colleges that the National 
Commission on Accrediting study ac- 
creditation of junior colleges by spe- 
cialized agencies, and continuing 
through the problems engendered by 
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the implementation of the Vocation- 
al Student Loan Insurance Act of 
1965, the fears of two-year vocation- 
al institutions for their institutional 
autonomy are sketched out. The 
need for positive structuring of the 
accrediting process is expressed. 

The accrediting function of the 
professional association is examined 
in depth, with a review of literature 
on the subject. A study made by the 
National Commission on Accrediting 
in 1961 is viewed for its present 
implications, and current accrediting 
activity by specialized groups in the 
community college is considered. 

A survey in January 1967 of 
agencies approved by the National 
Commission on Accrediting found 
that of 17 agencies reporting, 5 were 
engaged in community-junior college 
level accrediting activities at that 
time, 4 had discussed the issue 
but had no plans for engaging in this 
activity within the next 5 years, 
and 8 had not even discussed the 
possibility of engaging in accrediting 
activity at the two-year college level. 

Only about 12 percent of junior 
colleges listed in the 1967 American 
Association of Junior Colleges Direc- 
tory had programs which were ac- 
credited by specialized accrediting 
agencies. Despite this low level of 
specialized accreditation activity, the 
American Association of Junior Col- 
leges continues to oppose specialized 
accreditation at this level and to lean 
toward acceptance of only regional 
accrediting agencies. 

Another activity of the study, that 
of determining the views of institu- 
tions regarding accrediting activities 
of specialized agencies, was carried 
out through administration of a spe- 
cially developed questionnaire. The 
instrument was administered to three 
types of institutions: comprehensive 
community colleges with regional ac- 
creditation only, comprehensive com- 
munity colleges with both regional 
and specialized agency accreditation, 
and special purpose institutions (tech- 
nical institutes) with specialized ac- 
creditation. 

Data gathered from the responses 
to the questionnaire indicated that 



the overall group did not feel that 
their regional accrediting association 
was appropriately organized and 
staffed to evaluate technical pro- 
grams. Criteria used in evaluating 
vocational-technical programs were 
generally not considered appropri- 
ate. A majority of respondents 
agreed that institutions, such as area 
vocational schools and technical in- 
stitutes, which are not presently eligi- 
ble for accreditation, should be ac- 
credited by regional accrediting 
agencies. It was indicated that sepa- 
rate program evaluation carried out 
by regional agencies was the most 
desired course. 

Several particularly important is- 
sues were studied, using data 
gathered during the project. 

Issue Number I was, “To what 
extent are professional associations 
now approving curricula in commu- 
nity colleges? Has there been an 
effort on the part of these groups to 
accelerate their accrediting activity?” 
The answers to this question were 
derived from data gathered in the 
January" 1967 survey and, summar- 
ized, were that specialized accredita- 
tion in two-year colleges had de- 
clined and that it was not about to 
be accelerated. 

Issue Number II was, “Is there 
any evidence which indicates that 
specialized accreditation either inhib- 
its or promotes the development of 
occupational programs?” It was not 
felt that accrediting agencies helped 
in program development, but it was 
acknowledged that better students 
are more attracted to an accredited 
program. 

Issue Number III was, “Is there 
observable change in institutional 
autonomy as measured by modifica- 
tion of objectives or stated goals 
when specialized accrediting agen- 
cies are allowed to prescribe condi- 
tions or curricular patterns regarding 
program direction and/or staff utili- 
zation?” The study indicated that 
more autonomy is lost in complying 
with federal legislative requirements 
than in complying with accrediting 
agency specifications. 

Issue Number IV was, “Do spe- 
cialized agencies request conform- 
ance to conditions or standards which 
tend to place the institution at odds 
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with its own goals in such areas 
as student admission, performance of 
enrollees or employment of staff?” It 
was concluded that specialized ac- 
creditation was only one of the many 
reasons for which an institution might 
come at odds with its own goals. 

Issue Number V was “To what 
extent are regional accrediting agen- 
cies assessing vocational-technical 
programs in their evaluation of the 



total institution?” It was decided that 
little attention was given to specific 
programs in the overall accrediting 
assessments made by regional agen- 
cies. It was agreed that the ideal 
situation would be for the regional 
agency to revise its criteria for evalu- 
ation and to add vocational experts 
to its staff for evaluation purposes. 

Issue Number VI was determina- 
tion of the magnitude and direction 



of the conflict among various forces 
in higher education. Indications show 
that the two types of accrediting 
agencies, regional and specialized, 
seem to reinforce each other, and a j 
methodology should be devised 
which would allow the two to facili- 
tate each other. Such a cooperative j 
effort would also seem to reduce the j 
workload now being ..duplicated in \ 
many instances. 



Topic Two: PROGRAM EVALUATION 



See Bibliography for Information 
on availability of complete studies 



. . . in Vocational Agriculture 

Evaluation of the Effectiveness of Using 
Specialized Instructors in Providing Oc- 
cupational Training for Industrial lobs for 
High School Vocational Agriculture Stu- 
dents. Roy W. Roberts, et al. University of 
Arkansas, Fayetteville. 1965. 

This limited project was initiated 
as a result of problems encountered 
by senior vocational agriculture stu- 
dents of Magnet Cove, Arkansas, 
High School in finding training- 
related jobs after graduation. High 
school vocational courses did not 
prepare these young men for agricul- 
turally related jobs such as agricul- 
tural mechanics. In order to change 
the curriculums to include such cour- 
ses, it was necessary to find persons 
qualified to instruct in these areas. 

The regular agriculture teachers 
were unfamiliar with the subjects, 
and so an experimental program was 
established wherein three special in- 
structors employed in local industries 
taught for one hour each day for a 
six-week period. The special courses 
which they taught were blueprint in- 
terpretation, electricity and welding. 

Nine high school seniors at the 
school were enrolled in these cour- 
ses. The study centered around them 
was designed to determine whether 
or not (a) 'this training would assist 
the young men in making vocational 
choices, (b) the training would in- 
crease employment stability; (c) the 
apprenticeship training period would 
be reduced as a result of this train- 
ing, and (d) the school dropout 
level would be reduced as the result 
of this training. 

Evaluation and results of the ex- 
periment indicate success, although 
piore time and follow-up surveys are 



necessary to determine whether or 
not some of the more long-term goals 
were met. University of Arkansas 
consultants found the course content 
and methods of instruction to be 
satisfactory, and officials of local in- 
dustries expressed approval of the 
project methods. Students were inter- 
ested and .instructors were satisfied 
with student progress. The course 
reduced school dropouts and assisted 
students in making firm choices of 
occupations. 

It was felt that this experiment 
might well be tried successfully in 
other schools with similar problems. 

... in Business Education 

The Status of Cooperative Office Educa- 
tion Programs in Michigan 1967-1968. 
Elaine Uthe and Betty Schroeder. Depart- 
ment of Secondary Education and Cur- 
riculum, College of Education, Michigan 
State University, East Lansing, Mich. April 
1969. 

This study was conducted to de- 
termine the status of cooperative 
office education programs in Michi- 
gan so that teacher-coordinators 
might compare their programs with 
others in the state and to enable 
teacher-educators to identify major 
problem areas in order to more ade- 
quately prepare teacher-coordinators. 

A questionnaire mailed to 246 vo- 
cationally reimbursed cooperative 
office education programs in Michi- 
gan. during the 1967-1968 school 
year yielded 175 returns which were 
compiled for this report. Possible 
problem areas which may be en- 
countered by beginning teacher- 
coordinators were listed as: “(1) 
coordination of students on the job, 

(2) placement of student-learners, 



(3) instruction in the related class, 

(4) relations with the business facul- 
ty, (5) relations with the faculty in 
other areas, and (6) relations with 
the school administration.” 

Recommendations resulting from 
this study include that of formulating 
clear-cut distinctions between coop- 
erative programs and work-study 
programs through development of 
criteria for each program. It was 
recommended that criteria for the 
cooperative office education program 
should include guidelines regarding: 

“1. The related instruction portion 
of the cooperative program in terms 
of instructional objectives, recom- 
mended instructional materials and 
methods to maintain close correla- 
tion of job experiences and in-school 
learning experiences, and suggested 
facilities; 

“2. The coordination portion of 
the cooperative program in terms of 
numerical ratio of student-learners to 
teacher-coordinator in order to pro- 
vide adequate coordination time to 
accomplish program objectives; 

“3. The qualifications of the 
teacher-coordinator to insure mas- 
tery of subject matter, ability to deal 
effectively with students and adults 
in various positions, and professional 
interest in the advancement of stu- 
dents and program, and 

“4. The relationship of the cooper- 
ative method to the entire business 
program.” 

In addition, realistic experiences 
for future teacher-coordinators should 
be provided during their period of 
training, and prospective and be- 
ginning teacher-coordinators should 
have opportunities to attend confer- 
ences and meetings of teacher-coordi- 
nators. Supervision and assistance 
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should be provided the beginning 
teacher-coordinator during the first 
year by State Department of Educa- 
tion consultants or experienced teach- 
er-coordinators. 

Use of criteria for development 
and evaluation of programs is sug- 
gested as being necessary to the 
building of effective cooperative 
office education programs. 

A Study of the Effectiveness of Summer 
Data Processing Institutes for Business 
Teachers. Lewis E. Wall. College of Busi- 
ness, Colorado State University, Fort 
Collins, Colorado. Aug. 31, 1967. 

In order to assist teachers in ac- 
quiring the skills and knowledge 
necessary for teaching business data 
processing courses, five Summer In- 
stitutes in Business Data Processing 
for Teachers were held during 1963, 
1964 and 1965. During all three 
years a first-year program was con- 
ducted, and a second-year program 
was conducted during the last two 
years. 

The evaluations conducted during 
this project were designed to deter- 
mine if the institutes have helped to 
alleviate the teacher shortage in 
business data processing, to obtain 
the participants’ opinions as to the 
strengths and weaknesses of the in- 
stitutes, to determine the effec- 
tiveness of the institutes in teacher 
preparation, to determine factors 
which may aid or deter teachers in 
continuing on as data processing 
teachers, and to evaluate the possible 
shortage of data processing teachers. 

Results of data gathered from 
questionnaires administered to parti- 
cipants following their attendance at 
an institute or institutes demonstrat- 
ed that the institutes were effective 
in alleviating the data processing 
teacher shortage and that they were 
effective in teaching these specialized 
courses to the teachers. 

A questionnaire was also adminis- 
tered' for determining the partici- 
pants’ views regarding the strengths 
and weaknesses of the institutes. 
Participants generally expressed sat- 
isfaction with the facilities used in the 
institutes (physical factors of the 
meeting rooms and adequacy of 
equipment). They also felt that an 
adequate number of courses was 
offered, that the content of the cour- 
ses was adequate and that it was not 
too technical. 
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The number of instructors was 
generally considered adequate, al- 
though they felt that more “hands-on 
time” in the laboratories was needed 
and that scheduling of classes could 
have received a little more attention. 
The staff of the institutes was not 
endorsed as strongly as other aspects 
of the institutes. In particular, partic- 
ipants expressed a desire to have 
instructors devote more class time to 
teaching techniques. Methods of in- 
struction used were given favorable 
ratings, and much enthusiasm was 
expressed for the subject matter. 

More hesitation was expressed re- 
garding whether participants felt 
qualified to teach data processing 
courses following participation in an 
institute, and even less confidence 
was expressed in their ability to or- 
ganize a data processing program in 
their own schools. Questionnaire re- 
sults indicated a desire for opportu- 
nities for more contact with other 
participants and with instructors. 

Factors of age, prior work experi- 
ence, prior educational experience, 
sex, degrees, and whether receiving 
subsistence while attending an insti- 
tute were not found to have any 
effect on whether or not a partici- 
pant persisted as a data processing 
teacher for a period of time. 

A survey of the needs for data 
processing teachers in various types 
of institutions revealed that the de- 
mand for such teachers will become 
more pressing over the years, and 
that a great competition for teachers 
in this field will ensue, with salaries 
for competent persons being thereby 
increased. 

Based on the findings of this 
study, it was recommended that the 
institute project be reactivated under 
Federal Government sponsorship. 
Also, assistance should be given to 
colleges in the development of busi- 
ness data processing teacher training 
programs. 

... in Manpower Training 

The AMIDS Program: An Appraisal of the 
First Six Months. William A. Broadbent and 
Bruce A. Reinhart. Division of Vocational 
Education, University of California, Los 
Angeles. 1969. 

This report is the result of an 
appraisal carried out by the Re- 
search Center of the Division of Vo- 
cational Education, University of Cali- 



fornia, on the first six months’ oper- 
ation of the Area Manpower Instruc- 
tor Development Sites (AMIDS). 
The appraisal consisted of two parts: 
a questionnaire sent to all partici- 
pants in AMIDS seminars and inter- 
views of approximately 10 percent of 
these persons. Data obtained by 
these two methods are included in 
the report. It was found that the 
most significant data were obtained 
through the interviews, and future 
evaluations are planned with only 
the interviewing technique being 
used. 

AMIDS workshops were estab- 
lished in three cities, Detroit, Wash- 
ington and Los Angeles, in 1968 for 
the purpose of increasing “the in- 
structional competency and general 
awareness of the nature of relevant 
federal employment programs among 
Manpower instructors.” The Research 
Center appraisal of the first six 
months’ operation of the workshops 
and seminars of the program focused 
on'characteristics of the participants 
and their reactions to the program. 

A summary of the findings and 
conclusions indicates that although 
nearly two-thirds of the participants 
in the AMIDS seminars were in- 
structors, a number of supervisory 
personnel too large to be justified in 
an instructor-oriented program had 
participated. A change of program 
emphasis may be indicated due to 
this fact. 

It was found that instructors de- 
sired instruction in “job-seeking tech- 
niques” so that they might assist 
their students with placement. An- 
other area of desired instruction was 
in dealing with the special problems 
of physically and emotionally handi- 
capped students. 

The most, enthusiastic evaluations 
of the AMIDS workshop programs 
were received from participants hav- 
ing the following characteristics: (a) 
minority race/ethnic background, 
(b) relatively low level of formal 
education, (c) foreign language fa- 
cility, (d) instructor role in Man- 
power, and (e) occupational instruc- 
tor position. Obviously, the AMIDS 
program is meeting the needs of 
these people. 

However, these social and demo- 
graphic types are not the only ones 
for which the program is in oper- 
ation, and much less enthusiasm and 
appreciation was expressed for the 
program by persons with the follow- 
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ing characteristics: (a) Caucasian 

race/ethnic background, (b) rela- 
tively high level of formal education, 

(c) English language facility only, 

(d) supervisor-administrator role, 
and (e) nonoccupational instructor 
position. It is suggested that separate 
workshops with varied curriculum be 
developed and offered for these per- 
sons. 

' Although two of the major subject 
areas covered in the AMIDS semi- 
nars were “understanding of the pro- 
gram” and “sympathy towards stu- 
dents,” these remain as the greatest 
teaching weaknesses encountered by 
participants. At none of the teaching 
sites did participants feel their 
AMIDS experiences had resulted in 
improvement of their teaching skills. 

In fact, “participants were gener- 
ally unable to cite any specific 
teaching behavior that they had 
changed since attending AMIDS,” 
and most felt that something other 
than the workshops had aided their 
inservice growth. “The only formal 
presentation by staff which seems to 
have made much of an impression 
was that devoted to discussing the 
Manpower Development and Train- 
ing Act itself.” 

Responses from participants indi- 
cated that they felt their instructors 
and discussion leaders were compe- 
tent and interesting. But, greatest 
benefits were derived from “sharing 
ideas and experience with other par- 
ticipants.” 

A result of these findings was the 
formulation of a set of recommenda- 
tions for improvement of the AMIDS 
program. First, after redefining the 
goals of the AMIDS workshops, it 
should be determined whether or not 
large numbers of non-instructional 
personnel should continue to be in- 
vited as participants. If it is deemed 
desirable to do so, then the work- 
shops should be made relevant to 
their needs, perhaps through estab- 
lishment of separate workshops. 

More emphasis should be placed 
on presentations and discussions cov- 
ering “job-seeking techniques and 
trainee employment processes,” and 
specialists should be enlisted to dis- 
cuss problems encountered in deal- 
ing with physically and emotionally 
handicapped trainees. 

In order to provide more mean- 
ingful instruction in specific teaching 
behaviors, it is suggested that “the 
AMIDS program should be reori- 
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ented towards identifying more ac- 
curately present weaknesses in the 
instructional methods of partici- 
pants.” 

Finally, it is recommended that 
more attention and time should be 
devoted to discussions of basic social 
values and relevant vocational re- 
search findings which would help im- 
prove instructor effectiveness and the 
success of the entire Manpower pro- 
gram. 

The AMIDS questionnaire instru- 
ment and the instrument which was 
devised for interviewing selected 
participants are included as appen- 
dices to this report. 



Benefit-Cost Analysis of TAT Phase I 
Worker Training. Frederick C. Kirby and 
Paul A. Oastagna. Training and Technology 
Project, Oak Ridge, Tennessee. July 1969. 

This study was conducted for the 
purpose of determining costs and 
benefits both to the individual and to 
the Federal Government as a result 
of the time and resources invested 
during the Training and Technology 
Project Phase I. (See “Training and 
Technology: A Demonstration Man- 
power Development Project. Worker 
Training Program, Phase I” in RV, 
September 1969.) 

For purposes of the study, 70 
former TAT trainees were examined 
in comparison with 70 persons who 
had passed all tests for entrance 
to the TAT program but were not 
selected because of lack of space in 
the program. The benefit to the indi- 
vidual as a result of training was 
computed by comparing the amount 
of income he would have earned had 
he worked instead of entering the 
training program to the increased 
rate of income he will receive as a 
result of the training. 

It was determined that, “for each 
dollar of income foregone by the 
trainee, he received $2.60 during his 
first year of post-training employ- 
ment.” Financial benefit to the Fed- 
eral Government is based upon the 
amount spent on each trainee com- 
pared with the amount of estimated 
increase in income taxes to be re- 
ceived from each trainee in his life- 
time. T|iis return to the Federal 
Government was computed to be 
20.5 percent, assuming a 3 percent 
annual rate of income growth, and 
25.7 percent assuming *a 6 percent 
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rate (due to an annual inflation rate 
of 3 percent) . v 

It is important to consider other 
returns on the investment of the 
Federal Government, such as having | 
fewer numbers of persons on the I 
welfare rolls, and the higher social 
status of the population. In addition, 
TAT provided the labor market with 
needed skills. These aspects, of 
course, could not be computed into 
the cost-benefit analysis, but should 
be considered in evaluating the over- 
all value of the TAT program. 

. . . in T&l Education 



Development and Utilization of a National 
Vocational-Technical School Achievement 
Testing Program Using the Printing Trades 
as a Pilot Area. Dennis McFadden. Ohio 
Trade and Industrial Education Service, 
Division of Vocational Education, Colum- 
bus, Ohio. August 1967. 



Preliminary investigations having 
noted the lack of instruments for 
evaluating the level of occupational 
preparation and for evaluating the 
effectiveness of various training pro- 
grams offered, this project attempted 
to develop and validate tests for as- 
sessing the achievement of students 
in training programs in the printing 
trades. Such an evaluation instru- 
ment was deemed necessary because 
of the high cost of such programs at 
the secondary level, and the great 
waste which could result from 
ineffective programs. 

The design of this project con- 
sisted of the development of an 
achievement test to be administered 
to twelfth grade printing trades stu- 
dents for measuring their technical 
knowledge and skills related to this 
trade. In addition, a job performance 
measure was developed for adminis- 
tration to graduates of printing cour- 
ses who became employed in the 
printing trades. This test, given to 
the same students as the first, was 
administered eight to ten months af- 
ter graduation. Results from the two 
sets of tests would be compared and 
used as an index for evaluation of 
the training program itself. 

Specifically, the project attempted 
to measure student achievement by 
first defining “student achievement 
representative of the educational ob- 
jectives for a vocational printing 
course at the twelfth-grade level,” 
then selecting existing measures of 
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this achievement and developing ad- 
ditional ones, and finally by provid- 
ing national standardization of an 
achievement test through administra- 
tion of it to a group of students 
nearing completion of a twelfth- 
grade printing course. 

Employee job performance was to 
be measured by first defining the 
I mean job performance of recently 
I employed graduates of the courses, 
then developing reliable instruments 
[ for measuring job performance, and 
measuring the job performances of 
those students who had been origi- 
nally tested and who were now em- 
ployed in the printing trades. The 
measures of achievement and job 
'performance thus obtained would 
Ithen be related to provide an index 
for evaluating the vocational printing 
. trades course. 

| Through examination of the curric- 
ulums offered in the printing trades 
in secondary schools in Ohio, and 
through conferences with representa- 
tives of the International Graphic 
Arts Education Association, it was 
determined that two areas of 
achievement should be measured: 
knowledge and understanding of 
fundamental printing operations and 
ability to solve problems which arise 
in the printing industry. 

For measurement of the knowl- 
edge and understanding category, 
the “Ohio Printing Achievement 
Test,” a test already existent in mul- 
tiple choice form, was adopted. 
Problems arose in devising a test of 
the second area of achievement 
which would meet requirements of 
administration time, adequate stand- 
| ardization and objective scoring. A 
| “recognition type” of measurement 
was found to be usable in this area, 
and the “Ohio Printing Performance 
Test” was developed by the project 
| staff for use in this area of achieve- 
ment measurement. Both of the tests 
were given field trials. 

In the second phase of the study, 
which was devoted to developing a 
means of assessment of job per- 
formance, behavior traits of job per- 
formance were selected through con- 
ferences with graphic arts industry 
representatives. The traits selected — 
dependability, safety, quantity, care 
of tools, resourcefulness, neatness, 
[ accuracy, industriousness, reaction, to 
criticism, adaptability, communica- 
tion skills, organization of work, 
technical knowledge, and. job skill — 



were assessed for each vocational 
graduate who was now employed in 
the printing trades. 

It was concluded that “the 
procedures, methods, and assump- 
tions employed were adequate in 
providing for the development of 
valid, and reliable achievement mea- 
sures of vocational printing at the 
twelfth-grade level of instruction.” 
Use of these achievement’ measures 
is considered possible in determining 
the effectiveness of the instruction, 
thereby “allowing for the improve- 
ment and maintenance of quality ed- 
ucation in sound vocational pro- 
grams.” 

Appendixes to the report include a 
suggested printing course outline, a 
job performance rating form, and a 
questionnaire administered to print- 
ing trades course graduates. 

The Training of Tool and Die Makers. 

Morris A. Horowitz and |rwin L. Herrnstadt. 
Department of Economics, Northeastern 
University, Boston, Mass. September 1969. 

Tool and die makers in the Metro- 
politan Boston area were selected for 
testing of a methodology for determi- 
ning “the combination or combina- 
tions of education, training and ex- 
perience which were most likely to 
yield highly qualified workers in a 
specific occupation.” This occupation 
Was chosen because of its importance 
to manufacturers and the short sup- 
ply of qualified workers in it. 

Of the 400 tool and die makers 
from 53 establishments in the area, 
most had followed one of six basic 
training paths. The percentage dis- 
tribution of workers in each of these 
paths was: 



On-the-job training 22.5% 

Vocational high school .22.2% 

Picked-up-the-trade 15.8% 

Apprenticeship 14.2% 

Vocational high school plus 

on-the-job training .... 11.2% 

Vocational high school plus 

apprenticeship 9.8% 

Miscellaneous 4.2% 



It should be noted from these 
figures that the paths followed were 
diverse and that even the most 
formal methods of training were in- 
formal. Also, this is not an easily 
acquired trade: formal training had 
been taken by more than 80 percent 
of those interviewed. Subjects most 
often studied for use in this job were 



trigonometry, blueprint reading, use 
of measuring instruments, heat 
treating, machine theory, mechanical 
drawing, and tool design. These sub- 
jects were either studied outside or 
acquired on the job. 

The effectiveness of each training 
path was evaluated in terms of “(1) 
the performance ratings given to the 
men by their supervisors, (2) the 
length of time spent in training, and 
(3) the amount of time the tool and 
die makers estimated it took them, 
from the start of training, after their 
formal schooling, to become all- 
around competent craftsmen, and to 
be classified initially as toolmakers 
and diemakers.” 

Differences in performance ratings 
among training paths were not statis- 
tically significant, although workers 
in the “vocational high school com- 
bined with apprenticeship” and the 
“vocational high school” paths had a 
somewhat greater proportion of bet- 
tar-than-average ratings. Neither ap- 
prenticeship, nor taking of part-time 
courses, nor even the failure to finis h 
training seemed to affect the ratings. 

This similarity of ratings for all 
training paths may be attributed to 
‘‘the importance of innate ability 
and working experience, differences 
in the quality of training within 
paths, and the likelihood that suc- 
cessful training has characteristics 
that are unrelated to the formal 
structure of programs.” Also, there 
may be an even distribution of 
trainees with like abilities entering 
each training path. 

Average lengths for training peri- 
ods varied for the different training 
paths. For example, “vocational high 
school” averaged 2.7 years, “on-the- 
job training” averaged 2.9 years, and 
“apprenticeship” averaged 3.4 years. 
The longest training period was in 
the path of “picked-up-the-trade” 
which lasted an average of 7.3 
years. 

Many more years of experience 
after training were required before 
men felt themselves competent 
craftsmen; a minimum of six years 
before they considered themselves 
competent toolmakers, and a mini- 
mum of eight years to be a compe- 
tent diemaker. Individuals with vo- 
cational high school combined with 
apprenticeship required the shortest 
amounts of time before considering 
themselves competent all-around 
craftsmen. 



The shortest routes to receiving 
classification as a toolmaker or a 
diemaker were through the paths of 
“vocational high school” and “voca- 
tional high school and appren- 
ticeship.” The foremen’s ratings of 
their workers indicated that longer 
periods of training time did not con- 
tribute to performance. 

Effectiveness of the various train- 
ing paths was measured through 
foremen’s ratings, the time needed to 
become an all-around craftsman, 
and the time needed to become clas- 
sified as a toolmaker or diemaker. 

The path of “vocational high 
school and apprenticeship” scored 
well on most of these measures of 
effectiveness. None of the paths was 
poor in all or most areas. It was 
found to be very difficult to deter- 
mine the reasons for a good rating: 
age, years in the trade, years of job 
experience, amount of training, 



training path followed, etc., did little 
to back up a man’s rating. Discus- 
sions with those in the trade point 
more to factors such as inherent tal- 
ent for and interest in tool and die 
making. 

An extension of the study was 
devoted to the questions of breadth 
of craftsmanship and the problems 
encountered in the transition from 
school to work in these trades. Cer- 
tain paths of training were found to 
contribute more to breadth than oth- 
ers, but only “apprenticeship” in the 
case of diemaking was statistically 
significant. The more structured 
courses appeared to contribute more 
to the breadth of a man’s skill. Time 
spent working at the trade also had 
some effect on the breadth of skill. 

Because of the labor market de- 
mand for tool and die makers, stu- 
dents of all abilities and from all 



types of schools found employment, 
although those who had better-than- 
average abilities and who came from 
the better schools were more sought 
after. The boys most often located 
their own jobs, bypassing the inade- 
quate occupational counseling ser- 
vices or using them as a last resort. 

The conclusion of this study is 
that “comparing workers’ training 
with foremen’s ratings of job per- 
formance is a useful way to evaluate 
the effectiveness of particular train- 
ing patterns, particularly if done on a 
longitudinal basis that includes a de- 
tailed description of the exact con- 
tent and nature of a man’s training 
and later work experience.” In addi- 
tion, a listing is made of the more 
significant implications of the find- 
ings of the study for government, 
training programs, secondary schools, 
unions, employers, individuals, and 
further research. 



Topic Three: LOCAL EVALUATIONS 



See Bibliography for Information 
on availability of complete studies 



Cost-Effectiveness Study 

A Cost-Effectiveness Study of Vocational 
Education: A Comparison of Vocational and 
Nonvocational Education in Secondary 
Schools. Ernst W. Stromsdorfer, et al. 
Institute for Research on Human Re- 
sources, The Pennsylvania State Univer- 
sity, University Park, Pa. March 1969. 

This report attempts to answer, 
through development of an appro- 
priate theoretical framework and ob- 
taining of data relevant to the frame- 
work, the question: “Should the 
United States invest more money in 
vocational education, given alterna- 
tive investment opportunities in other 
educational , curricula?” It is expected 
that the methodology formulated for 
this study can be used by federal and 
state agencies in conducting cost- 
effectiveness studies of education. 

The cost-effectiveness method of 
evaluation was used in order to 
bridge the gap between evaluations 
which have centered on expenditures 
only, and those which have had as 
their main focus the fulfillment of 
objectives of various programs. The 
admission is made in the report that 
cost-effectiveness analysis has not 
yet been perfected, and inadequacies 
are duely noted in order to provide a 

40 



basis for further research and experi- 
mentation. However, it is felt that 
the current amount of knowledge on 
cost-effectiveness is enough to begin 
with, and that this method is much 
better than decisionmaking through 
the old methods of “guess and intui- 
tion.” 

Three cities were selected for this 
study. Two cities have their second- 
ary vocational-technical educational 
facilities concentrated in a vocation- 
al-technical school which is separate 
from regular academic high schools. 
The third city also has vocational- 
academic high schools where stu- 
dents may follow either a vocation- 
al or an academic curriculum. 

Four main steps were involved in 
the study: “First, all costs and ben- 
efits were identified and representa- 
tive data were collected. Second, the 
conceptual difficulties were resolved, 
where possible, and the appropriate 
criteria for investment decisions were 
determined. Third, the data were 
analyzed by statistical methods, and, 
by comparing costs and benefits, the 
return to the investment was ascer- 
tained. Finally, other related issues 
which might affect the analysis were 
considered.” All costs, including 
marginal, total and average, were 
measured. 



Cost data were obtained for the 
various city schools and school sys- 
tems. Data obtained were not uni- 
form enough to make cost compari- 
sons between the cities, but cost- 
effectiveness analysis was possible 
with data obtained from two of the 
cities. Benefit data wsre obtained 
through questionnaires sent to a 1,- 
255 sample of 1959 and 1960 grad- 
uates of the high schools. Data on 
labor market histories, curriculum, 
sex, race, marital status, city of grad- 
uation, IQ measures, and father’s 
education were obtained by this 
means. A copy of the questionnaire 
is included as an appendix to the 
report. 

The most complete cost data were 
obtained from the third city — the 
one which has not only vocational- 
technical and comprehensive high 
schools, but also vocational- 
academic. Data obtained for this city 
included: principal salaries, teacher 
salaries, supervision and clerical sal- 
aries, educational supplies, free text 
and library books, other instructional 
expenses, operation, maintenance, 
administration, fixed charges, other 
services, and capital outlay. 

In addition, data were obtained on 
physical characteristics of: (a) en- 
rollment by grade, for selected 
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months; (b) median and average 
class size for selected months; (c) 
size distribution of classes, by course 
area, for selected months, (d) size 
distribution of teachers’ salaries by 
: teacher qualification; (e) average 

daily attendance and average daily 
membership; (f) number of teach- 
ers, and (g) number of classes, 
i Benefits measured included both 

I labor market benefits and nonmone- 
tary benefits. Labor market benefits 
are measured by the indices of 
“money earnings and the percent of 
| time employed out of total -time 
which could be devoted to civilian 
labor force participation.” Variables 
measured for nonmonetary benefits 
were “training relatedness of the job 
;» or jobs held, overall career related- 
ness of the job or jobs held, and 
whether or not knowledge of the job 
:j or jobs came mainly from the high 
school or from some type of on-the- 
job experience.” 

Noneconomic variables which in- 
dicate the socialization effects of ed- 
ucation were also measured. Three 
of these were: (a) “the number of 
clubs or organizations of which the 
' graduate is a member at the time he 
was interviewed,” (b) “whether or 



not the graduate voted in the 1966 
primary elections,” and (c) “wheth- 
er or not the graduate voted in the 
1964 presidential election.” 

Two most important tables of data 
were developed regarding economic 
benefits: “The Relationship Between 
Secondary Curriculum and Percent 
of Time Employed During the Six- 
Year Post-Graduation Period, by 
Sex” and “The Relationship Between 
Secondary Curriculum and Average 
Monthly Before Tax Earnings Dur- 
ing the Six- Year Post-Graduation 
Period by Sex, in Dollars.” (The 
tables are reproduced below.) 

It should be noted that, while 
costs are generally more easily mea- 
sured than benefits, the reverse is 
true for this study. This is due to the 
lack of usable data related to costs, 
and it points up the need for more 
efficient recordkeeping in cost- 
related matters if cost-effectiveness 
evaluation is to become effective. 

The sample taken for this study 
implies that “vocational-technical ed- 
ucation is an economically worth- 
while investment for individuals and 
for society.” However, “considerable 
refinement” is still needed of techni- 
ques used in this study and of the 



methods of recordkeeping by educa- 
tional institutions. 

Definite conclusions cannot be 
reached on the basis of this study 
alone, because of the limited data 
available from some of the sources. 
Should further studies arrive at con 
elusions similar to the preliminary 
conclusions of this study, however, 
more concrete conclusions may be 
reached. Thus far, the only conclu- 
sion which can even be provisionally 
made is that “for two, and possibly 
all three, of the cities which partici- 
pated in this study, more funds 
should be devoted to vocational- 
technical education relative to non- 
vocational-technical senior high school 
curricula.” 

Evaluation Systems 

Evaluation Systems for Local Programs of 
Vocational-Technical Education. Harold M. 
Byram. Michigan State University, East 
Lansing, Mich. October 1968. 

This study, in which 10 Michigan 
school systems participated, was 
made to determine whether schools 
in the state were able to conduct 
self-evaluation of their vocational 
education programs J'with emphasis 
on outcomes and attainment of local 
objectives, maximizing the use of lo- 
cal personnel and resources, and 
utilizing consultant leadership and 
related professional assistance.” 

A previous project had resulted in 
a systematic approach to local pro- 
gram self-evaluation which worked 
successfully in three test school sys- 
tems. The objectives of this study 
were to: 

1. Test the system further on the 
local level. 

2. Identify new or improved 
procedures for use in local programs. 

3. Establish dn environment for 
personnel to learn evaluation 
procedures. 

4. Delineate the role of consult- 
ants in program evaluation. 

5. Identify potential research and 
development centers. 

Two members of each school’s 
staff were appointed to constitute a. 
leadership team for working with the 
project leader. The Michigan State 
University Research and Develop- 
ment Program in Vocational- 
Technical Education staff and con- 
sultants from the Michigan Depart- 
ment of Education acted in an advi- 
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The Relationship between Secondary Curriculum and Average Monthly 
Before Tax Earnings During the Six-Year Post-Graduation Period, 

by Sex, in Dollars 





Average Mouth ly 
Before Tax 
Earnings Over the 
Six-Year Post- 
Graduation Period 


Average Monthly 
Before Tax 
Earnings for the 
First Year After 
Graduation 


Average Monthly 
Before Tax 
Earnings for the 
Sixth Year After 
Graduation 


Curriculum 


Male 


Fe- 

male 


Total 


Male 


Fe- 

male 


Total 


Male 


Fe- 
male Total 


Vocational-Academic 

Vocational- 


419 


292 


315 


324 


239 


254 


482 


274 310 


Comprehensive 


476 


243 


283 


354 


248 


264 


556 


191 253 


General 


434 


228 


326 


315 


210 


260 


533 


179 347 


Vocational-Technical 


453 


264 


309 


327 


250 


268 


549 


243 317 


Academic 


417 


223 


282 


269 


204 


224 


506 


188 283 


Total 


444 


250 


300 


316 


238 


258 


536 


217 299 



The Relationship between Secondary Curriculum and Percent of Time Employed 
During the Six-Year Post-Graduation Period, by Sex 



Curriculum 


% of Time Employed 
Over the Six-Year 
Post-Graduation Period 


% of Time Employed 
in the First Year 
After Graduation 


% of Time Employed 
in the Sixth Year 
After Graduation 


Male 


Female 


Total 


Male 


Female 


Total 


Male 


Female 


Total 


Vocational- 




















Academic 


87.9 


77.3 


79.1 


84.4 


75.4- 


77.0 


91,7 


63.2 


38.1 


Vocational- 




















Comprehensive 


94.9 


73.0 


76.1 


85.5 


83.3 


83.7 


96.8 


,53.6 


61.0 


General 


91.6 


68.7 


79.6 


81.3 


75.1 


78.1 


95.4 


47.0 


70.0 


Vocational- 




















Technical 


93.0 


75.5 


79.7 


84.6 


82.9 


83.3 


97.7 


62.6- 


71.1 


Academic 


90.9 


66.3 


73.7 


75.2 


69.2 


71.0 


96.9 


48.2 


62.9 


Total 


92.4 


72.8 


77.9 


82.1 


79.7 


80.3 


96.8 


56.7 


67.0 
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sory capacity on the project. Meet- 
ings were held to inform participants 
of the project objectives, to make 
plans for getting the project under- 
way, and to work with them to iden- 
tify particular problems needing at- 
tention of the project in their school 
systems, 

A three and one-half day work- 
shop and conferences were held in 
each school to follow up on the 
workshop in: (a) “setting local proj- 
ect objectives,” (b) “developing 
broad outlines and/or steps in each 
local project,” (c) “planning for the 
organization of local school staff and 
resources for evaluation.” In addi- 
tion, local schools were encouraged 
to conduct their own workshops for 
preparing local staffs in procedures 
used in the evaluation system. 

Success of the project was analyzed 
through collections of data from -the 
participating school systems and 
through interviews with local staff. 
The evaluation system was demon- 
strated successfully in nearly all of 
the participating schools. 

Elements relevant to local pro- 
gram self-evaluation were revealed to 
be: “(a) administrative endorsement 
and support; (b) a local leadership 
team; (c) a program of local leader- 
ship preservice and inservice train- 
ing; (d) an evaluation project plan; 

(e) a staff committee for evaluation; 

(f) staff time for evaluation; (g) ob- 
jectives and curricular analysis; (h) 
advisory committees for assistance in 
the evaluation; (i) follow-up study of 
former students; (j) use of consult- 
ant help and instructional materials 
in development and use of evalua- 
tion instruments, and (k) adequate 
reporting of activities.” 

Suggestions emanating from the 
successful demonstration of 'the eval- 
uation system during this project in- 
clude that of extending the system to 
other school systems in Michigan 
and in other states. Use in other 



NEXT MONTH . . . Research Visibil- 
ity will present important aspects of 
the National Conference on Research 
held at Oklahoma State University 
in April 1969, and of the Research 
Handbook for Vocational-Technical 
Education which was derived from 
the presentations at the conference. 
Guest editor will be Dr. William 
Stevenson, director of the Research 
Coordinating Unit at Oklahoma State. 



states would determine the generaliz- 
ability of the system in other organi- 
zational patterns. Also suggested was 
that the system be tried out in com- 
munity college programs of vocation- 
al-technical education and under 
other leadership, such as a state de- 
partment of education or a research 
coordinating unit, 

A manual, Evaluation of Local Vo- 
cational Education Programs, A Man- 
ual for Administrators, Teachers, and 



Citizens, was published in a second 
edition in order to include ideas tried 
out and found to be successful dur- 
ing this project. Appendices to the 
study include capsule descriptions of 
local projects, a project staff study 
entitled “The Role of the Consultant 
in Evaluation of Looal Vocational 
Education Programs” and another 
titled “An Example of the Use of a 
Vocational Education Information 
Inventory.” 



Program Analysis Questionnaire for Vo-Tec Education 



Program Analysis Questionnaire for Voca- 
tional and Technical Education. Rhode 
Island Department of Education, Division 
of Vocational-Technical Education, Provi- 
dence, R. I. 

The rapidity of expansion of voca- 
tional-technical programs in Rhode 
Island resulted in a need for a means 
of evaluating these programs in or- 
der to make them more responsive to 
student needs. The Program Analysis 
Questionnaire is an instrument for 
analyzing all aspects of the vocation- 
al-technical program. 

The questionnaire was developed 
by the Division of Vocational- 
Technical Education of the Rhode 
Island State Department of Educa- 
tion, through review of existing eval- 
uative instruments, consultation with 
regional and federal offices of educa- 
tion, and contact with universities, 
doing research in program evaluation. 
Guidelines for format and content of 
the questionnaire were consolidated 
from materials in use in several other 
states. 

The questionnaire is divided into 
four major sections: administration 
and guidance, curriculum, physical 
facilities, and instruction. A three- 
dimensional approach to evaluation 
including “(a) self-analysis by local 
school administration and vocation- 
al-technical school staff, (b) analysis 
by evaluation team, and (c) analysis 
by industry representatives,” was es- 
tablished. 

In conducting an evaluation, the 
associate commissioner of vocation- 
al-technical education first identifies 
the particular program to be evaluat- 
ed and names an evaluation team of 
Department of Education staff mem- 
bers. The team consists of a team 
leader, specialists in vocational 
guidance, curriculum and facilities, 



an area school coordinator from a 
school district other than the one 
being evaluated, and an academic 
educational specialist. 

The local superintendent is in- 
formed of the purpose and 
procedures of the evaluation, and ori- 
entation and distribution of the eval- 
uation instrument are carried out for 
local school personnel. Completed 
questionnaires are returned to the 
Vocational Division Office where 
they are tabulated and analyzed 
along with questionnaires completed 
by industry representatives for each 
occupational area and those com- 
pleted by members of the evaluation 
team. Findings are reported to a 
local advisory committee and local 
school personnel, a final evaluation 
report is written, and recommenda- 
tions are followed up. 



Curriculum Materials 

The Curriculum Section of the 
Division of Vocational and Tech- 
nical Education, U.S. Office of 
Education, has compiled listings 
of curriculum materials which are 
available from States ' for each 
specialized area of vocational, 
technical education. Listings are 
available for Agricultural Edu- 
cation, Distributive Education, 
Health Occupations, Home Eco- 
nomics, Office Occupations, Tech- 
nical Education, and Trade and 
Industrial Education. 

In addition, an addendum cov- 
ering all services and a list of in- 
structions for ordering these cur- 
riculum materials are available. 
To order one or all of these list- 
ings, write to Mr. William Bemdt, 
Curriculum Section, Division of 
Vocational and Technical Educa- 
tion, U.S. Office of Education, 
Washington, D.C. 20202. 
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Topic Fours OTHER STUDIES 



The Teacher’s Role 

Vocational Programs in the Public Schools: 
The Role of the Teacher, Eleanor P. God- 
frey, Bureau of Social Science Research, 
Inc,, Washington, D.C, February 1969. 

This report presents the major 
findings of a nationwide survey of 
249 secondary and post-secondary 
schools, including comprehensive 
high schools, vocational high schools, 
vocational-technical centers, and 
junior or community colleges. Re- 
sponses were received from 11,649 
administrators, counselors and teach- 
ers. According to the report, “a ma- 
jor purpose of the study was to com- 
pare the backgrounds, training, and 
satisfaction with teaching of second- 
ary and post-secondary academic 
and vocational teachers.” In addi- 
tion, the opinions of teachers, coun- 
selors and administrators were 
sought on various educational issues. 

Separate questionnaires were ad- 
ministered to administrators, faculty 
and counselors. (Copies of these 
questionnaires are appended to the 
report.) Topics covered included the 
areas of school setting, teacher back- 
* ground and training, and teacher 
opinions. 

Analysis of the school setting in- 
' eluded a survey of course offerings. 
The major difference between offer- 
ings at the secondary and the post-sec- 
ondary level was the increased vari- 
ety of offerings at the post-secondary 
level. Secondary schools typically 
offered between three and five major 
programs, while a large junior col- 
lege would offer six programs, in- 
cluding two (college transfer and 
health occupations) which ate not 
found in secondary schools. 

Enrollment patterns, the presence 
of work programs, and predictions of 
educational progression of students 
are discussed in the report. Re- 
garding faculty requirements and in- 
ducements, it was found that the 
usual minimum educational require- 
ment is a B.A. degree, and that 
recruitment and maintenance of an 
able faculty would be facilitated by 
better working conditions, facilities, 
and the ability to offer “merit pay.” 

Data gathered from responses to 
questions regarding teacher back- 



ground and training indicate that 
most teachers have a B.A. degree 
and are continuing to upgrade this 
with inservice training and graduate- 
level courses, Although the median 
vocational instructor has five to nine 
years of full-time outside employ- 
ment experience, the most frequent 
response to this question was that of 
no outside employment experience. 
Vocational teachers generally have 
fewer students per class, and fewer 
nonteaching duties. Most teachers 
expressed satisfaction with their roles 
as classroom teachers, with the major 
dissatisfactions being lack of plan- 
ning time and poor administration. 

Teacher opinions were polled on 
subjects of personal autonomy, ade- 
quacy of school services, curriculum 
emphases, and nine controversial pol- 
icy issues in education. 

An analysis of questionnaire re- 
sponses was also made by type of 
school. In regard to the adequacy of 
the secondary curriculum, responses 
were very consistent in rating the 
major function of the school as 
above average, and the secondary 
function of the school as average. 
For example, respondents from com- 
prehensive schools listed the academ- 
ic program as above average, and 
the vocational program as average. 
The reverse was true of the vo- 
cational schools. 

Post-secondary personnel in tech- 
nical institutions rated their voca- 
tional program the same as the per- 
sonnel from the secondary vocation- 
al schools — above average. Howev- 
er, this was not true for the vocation- 
al placement services, which re- 
ceived only an average rating, and a 
below average rating from 35 per- 
cent of the teachers. Ratings for 
junior college programs were good 
for both types of programs (terminal 
and transfer). 

Curricular changes suggested for 
high schools would make the two 
programs, vocational and academic, 
more similar by adding more mathe- 
matics and science to the vocational 
curriculum and more mathematics 
and vocational training to the college 
preparatory curriculum. 

Im plications for policy change of 
the data gathered in this survey in- 
cluded the idea that further exami- 



See Bibliography for Information 
on availability of complete studies 



nation should be given the recom- 
mendation that “high schools should 
move toward a dual purpose in gen- 
eral curriculum.” Changes which re- 
spondents suggested should be made 
in high school curricula and junior 
college degree programs “imply that 
all of the traditional requirements, 
particularly those instituted at the 
behest of the senior college, may not 
be necessary.” 

Further investigation should be 
made into the low ratings which 
were given student counseling and 
placement services. The respondents 
indicated that these services in their 
schools “have done a better job of 
meeting the demands of the labor 
market and of the colleges rather 
than the needs of the students,” 

Because most respondents stated 
that “the vocational major can make 
it in college, particularly if the stand- 
ards for the academic component of 
the high school vocational program 
are raised,” investigation should be 
made of revision of the high school 
program along a new curricular pat- 
tern. It is suggested that if this type 
of change were made, then “formal 
specialized occupational training 
would necessarily become the re- 
sponsibility of the post-secondary in- 
stitution.” 

A System for State Evaluation 

A System for State Evaluation of Voca- 
tional Education. Harold Starr. The Center 
for Vocational and Technical Education, 
The Ohio State University, Columbus, Ohio. 
August 1969. 

Presented in this report is an inter- 
im model for planning, monitoring, 
evaluating, and redirecting programs 
of vocational education. The model 
is derived from an as yet incomplete 
project, “The Development of a 
Model To Evaluate State Programs 
of Vocational Education.” It has 
been presented prior to the com- 
pletion of the major project so that it 
may be available in time for use by 
state staffs preparing plans and eval- 
uation systems in response to feder- 
al requirements. 

After careful consideration of two 
existent methods of evaluation, “tra- 
ditional process evaluation” and “all- 
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inclusive data banks,” it was decided 
that neither of these processes could 
supply the data which initial investi- 
gations had determined to be neces- 
sary for evaluation in the “current 
operating situation of the states.” It 
had been determined that the need 
was for a system which would 
provide not only information for an- 
nual and long-range planning and 
redirecting of efforts, but that it must 
provide the accountability required 
by state and federal governments. 

This system, therefore, was de- 
signed to provide “information es- 
sential for planning and for redirec- 
ting the programmatic efforts of state 
vocational education agencies . . .” 
and to “ . . . provide decision- 
makers with information essential to 
the development of annual and long- 
range program plans.” 

A systems approach was taken in 
planning of the program, which re- 
quired that: “(1) the evaluation 
problem be defined in terms of the 
purposes and expected outcomes of 
programs; (2) an information (mea- 
surement) system be formulated to 
provide the particular data required 
for evaluative decisions about pro- 
gram outcomes; (3) feedback 
mechanisms be provided to permit 
monitoring of the effectiveness and 
efficiency of the information system 
in providing significant data for deci- 
sionmaking; (4) an interpretive s5's- 
tem be formulated by which in- 
formation is analyzed and presented 
to decisionmakers in a format 
which facilitates decisionmaking; and 
(5) since the evaluation system is 
only one part of a total program- 
planning system, the evaluation sys- 
tem be capable of articulation with 
other components (PPBS, for exam- 
ple) of a larger program-planning 
system.” 

The first phase of the project con- 
sisted of the design of the model 
system and its field testing. First, the 
model system was conceptualized, 
with the major uses for the system 
being defined and a system being 
organized which would accomplish 
these purposes. Then, state agency 
program objectives and goals were 
formulated and “quantitative pro- 
gram goal statements which are used 
to assess achievement of the program 
objectives” were identified. Data 
which would be needed to determine 
success of a program were specified, 



and procedures for using evaluation 
results in developing program plans 
were developed. The model system 
was then field tested in states which 
were cooperating on the project. 

After assessment of the field test 
results, a second phase was initiated 
in whbh a revised data system was 
formulated. This data system incor- 
porated seven data-collection instru- 
ments, six of which are used to col- 
lect data from local sources. Among ^ 
these instruments are a vocational 
program status form, a school in- 
formation inventory, a specific pro- 
gram information data form for sec- 
ondary and post-secondary instruc- 



Utilization of Volunteer Industry-Education 
Advisory Committees for Evaluating a 
State Vocational-Technical Education Sys- 
tem. Samuel M. Burt, The W.E. Upjohn 
Institute for Employment Research, Wash- 
ington, D.C. 1969. 

This paper presents an outline and 
a criticism of the strategy and 
procedures adopted for one phase of 
a project conducted jointly by the 
State Department of Education of 
Arkansas, The Industrial Research 
and Extension Center of the Univer- 
sity of Arkansas, and the Upjohn 
Institute under a grant from the U.S. 
Office of Education. 

The project involved business, in- 
dustrial, community and state lead- 
ers and decisionmakers in a process 
of “assessing the status and plans of 
the vocational-technical education 
system of the State vis-a-vis its 
economic development plans,” and 
the phase studied in this paper is 
that of “dealing with the evaluation 
of the vocational-technical education 
system of the State by the advisory 
committees.” 

Eight Regional Advisory Councils 
comprised of representatives of in- 
dustry and business (including com- 
munity leaders, legislators and edu- 
cators) were organized for the pur- 
pose of conducting school program 
evaluations and making related rec- 
ommendations regarding economic 
development needs and plans. In ad- 
dition, a State Manpower Advisory 
Council for Economic Development 
was organized for coordination of the 
work of the Regional Councils. 

In order to provide Regional Ad- 



tional programs, a specific program 
information data form for adult in- 
structional programs, and a data 
form in two parts used to obtain 
student characteristic data. The sev- 
enth instrument is used at the state 
agency level, and it is a collection 
of state division of vocational educa- 
tion evaluation and planning data. 

These' instruments were pilot 
tested, with the final testing being 
completed in December 1969. Fol- 
lowing this pilot test a final evalua- 
tion model will be produced at The 
Center for Vocational and Technical 
Education and will be available for 
dissemination to potential users. 



visory Council members with back- 
ground information of the State vo- 
cational and technical education sys- 
tem, four papers were prepared for 
them by the project staff: “A Look 
at Arkansas High Schools and Their 
Occupation Education Programs,” 
“A Look at Private Trade and Busi- 
ness Schools in Arkansas,” “Industri- 
al Plant Site Location and Vocation- 
al Schools and Programs,” and “An 
Overview of Arkansas Student En- 
rollments, Course Completions and 
Expenditures for Federally Reim- 
bursed Vocational Education Pro- 
grams.” A fifth paper, “Enrollments, 
Income, Expenditures and Programs: 
Area Vocational-Technical Schools in 
Arkansas,” was presented and dis- 
cussed at Regional Council meetings. 
The findings of these papers were 
translated in terms of the programs 
and problems of schools in the region 
of each particular advisory council. 

Several meetings were held by the 
Regional Advisory Councils for re- 
view of findings, progress reports and 
preparation of recommendations 
relative to their region. A final re- 
port of recommendations was 
prepared for submission to the State 
Council. A final report was also 
prepared by the State Council and 
presented to the State Board of Vo- 
cational Education, with the expecta- 
tion that the recommendations in the 
report would be given first priority 
by the State Board, the State Depart- 
ment of Education, the Governor’s 
Office, and the State Advisory Coun- 
cil for Vocational Education. 

The use of volunteer businessmen 
as an evaluative force for vocational- 
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technical education was demonstrat- 
ed to be feasible by this projeot. 
With the assistance and guidance 
. from the background papers and 
other materials provided by the pro- 
ject staff, workable solutions were 
obtained for some of the problems 
facing vocational-technical education 
in the community. It now remains to 
be seen whether or not these groups 
- can continue in their work toward 
' having their recommendations imple- 
mented. 

Student Teaching in Home Ec 

The Evaluation of Student Teaching in 
Home Economics: Final Report. Helen Y. 
Nelson and Joan Gritzmacher. New York 
State College of Home Economics, Cornell 
University, Ithaca, N.Y. May 1967. 

The “critical incident/technique” 
was used in this study to determine 
the performances resulting in effec- 



tive or Ineffective student teaching 
behavior and to construct a scale for 
evaluation of student teaching per- 
formance. The scope of this -study was 
limited to student teachers in home 
economics, and cooperation was ob- 
tained from teachers, college super- 
visors and student teachers in 20 
institutions from a number of states. 

These groups submitted 563 criti- 
cal incidents, of which 550 were 
vjable. From these 550 incidents, 
958 specific behaviors were ob- 
tained. The critical behaviors were 
constructed into a 112ritem rating 
scale which was administered at the 
end of the student teaching period to 
students, teachers and supervisors. 
An opinionnaire sent along with the 
rating scales indicated respondents 
felt that this rating scale was better 
than the one they were presently 
using, and that it' took less time to 
use. 



plain talk George 

Fun at acronym making? “Alphabet 
soup,” a term which has been with 
us for several generations and which 
makes up a glossary of its own, par- 
ticularly of governmental agencies 
and various projects, has its personal 
appeal and challenge as a gaming de- 
vice, at leasit to the bureaucratic in 
soul. The Advisory Committee for 
Research Visibility numbers among 
its membership at least one person of 
the research bureaucracy nature who, 
after lengthy nonscientific study of the 
RV masthead which has traditionally 
stated its mission as Synthesis / 
Application / Dissemination, ar- 
rived at the brutal conclusion and 
accusation that according to his 
acronym Research Visibility is SAD. 

Happily, the construction and 
deep insight which resulted in the 
accusing SAD acronym, and the 
acronym itself, were not shared by 
the committee other than through the 
humorous incident it provided during 
the review and appraisal of RV prog- 
ress. Editorial policy insists that we 
share the anecdote with our reader- 
ship; the name of coiner of the SAD 
acronym will never be revealed un- 
less more appropriate punishment 
cannot be determined. 



L. Brandon, Editor, Research Visibility 



The “alphabet soup” incident does 
have its more serious side. What has 
been achieved by the “yellow pages” 
over their short history? What will 
be more successful in meeting the 
needs of the majority of AV Journal 
readers which are related to research 
and development? What should be 
the target of the potential of reader- 
ship as the AV Journal is currently 
distributed to more than 52,000 
readers? The Advisory Committee 
had many suggestions, too many to 
use and implement. These were 
shared with RV readers in a previ- 
ous “Plain Talk” section. The pre- 
vailing suggestion that RV should 
zero in on the synthesis idea has 
come up for continued examination 
with a great deal of enthusiasm and 
expectancy. 

Research synthesis and interpretation 
as new missions. In the minds of a work- 
ing committee including a few mem- 
bers of the RV Advisory Committee 
(Aaron J. Miller of The Center for 
Vocational and Technical Education 
at The Ohio State University and 
Sidney High of the U.S. Office of 
Education), research results should 
be summarized and interpreted; in- 
terpretations should point the way 



It was concluded that the project 
had developed “a valid, reliable and 
useful rating scale ... for the evalu- 
ation of student teaching in home 
economics.” According to the report, 
this method could be successfully 
adopted for other fields and for other 
purposes. 

Suggestions for further study in 
this area include that of training 
raters in use of the scale to promote 
uniformity in rating and to develop a 
rating scale whereby pupils may rate 
the student teachers. Also, the scale 
might be used in evaluating the per- 
formance of first-year teachers. 

Copies of the rating scales used in 
this study and the opinionnaires 
which accompanied them are in- 
cluded in the appendices to this re- 
port. There is also a page of in- 
formation which it has been sug- 
gested should accompany the rating 
scale in future use. 



for desirable changes to be made for 
more effective programs of vocation- 
al and technical education at all 
levels. 

If all of this is possible (and there 
is a great deal of academic argument 
that it is neither posssible nor partic- 
ularly desirable as viewed by various 
antagonists) there is an underlying 
assumption that in the first place 
practitioners are sensitive to change 
and their practices amenable to al- 
teration. Hosted by Robert Taylor, 
director of the Center, with the gen- 
erous assistance of Center staff Joel 
Magisos and Celianna Taylor, and 
William Stevenson of Oklahoma 
State University’s Research Coordi- 
nating Unit, the working group draft- 
ed the dimensions of a new design 
for RV of the future. 

The target group, then, is the 
teacher-practitioner readership of 
the profession, the over-riding major- 
ity of the AVA membership. Re- 
search and development results should 
be summarized and interpreted for 
their consideration and implementa- 
tion. Essentially this fact assumes 
that a high degree of relationship 
will exist between the nature of the 
research which is investigated and 
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the realism of front-line operating 
problems in teaching and conduct of 
local programs. 

Obviously, more communication 
and a more effective dialogue be- 
tween practitioner and research- 
interpreter will have to be cultivated 
and maintained. The design of the 
new RV format will attempt to over- 
come problems of this nature and 
many others. Notwithstanding the 
difficulty of making RV reporting 
more functional in its “yellow pages” 
of the future, the still more difficult 
task of sampling and ascertaining 
readership interests will be con- 
fronted with new vigor. 

No doubt, the RV editor’s enthusi- 
asm could be dampened by visions 
of a management monstrosity in the 
midst of the synthesis-interpretation 
syndrome, but the many desirable 
results of research utilization includ- 
ing program change and maximum 
benefit to vocational youths and 



adults dispel management problems, 
real and imaginary. 

Do not expect the synthesis idea 
to show up in final form, subject to 
design and grantsmanship, before the 
September 1970 issue. But if you 
like the idea, or if you think it a 
total waste of time, paper and ink, 
let us have your reactions. You are 
the reader, it is your journal, and 
your ideas are solicited. If, even hu- 
morously, there is an element of 
SADness in Research Visibility , let’s 
make it more functional — or get a 
new acronym. 

Selected “must read” evaluation litera- 
ture. The printing presses of the na- 
tion work overtime in producing the 
literature of evaluation including the 
analysis, philosophy and research re- 
lated to it. The following might com- 
prise a “best seller” list. 

— National Society for the Study of Edu- 
cation. Educational Evaluation: New 



Holes, New Means. Ralph W. Tylet, 
Editor. Chicago: 5835 Kimbark Ave., 
60637. 

— W. E. Upjohn Institute for Employment 
Research. Available pamphlets. Wash- 
ington, D.C.: 110M7th St., N.W., 

20036 (free) 

—Educational Research Service. Evalu- 
ating Teacher Performance. Washing- 
ton, D.C.: ERS, 1201 16th St., N.W., 
20036. $1.50. 

— American Educational Research Associ- 
ation, Curriculum Evaluation Mono- 
graph Series: 

* 1. Perspectives of Curriculum Evalu- 

ation 

*2. Evaluation Activities of Curricu- 
lum Projects: A Starting Point 
*3. Instructional Objectives 

4. Research Strategies for Evaluating 
Training 

5. Evaluation as a Tool in Curriculum 
Development: The IPI Evaluation 
Program 

* Available now from Rand-McNally and 
Co., P.O. Box 7600, Skokie, 111., 60680. 
Price: $2.00 (AERA membership dis- 
count: 30%) 
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Public Instruction, Madison. August 1968. 
77 pages. (ERIC # ED 025 653. HC: 
$3.95, MF: 500.) 

“A Cost-Benefit Study of Post-High 
School Technical Education in Oklaho- 
ma.” Robert Lee Dupree. Oklahoma State 
University, Stillwater. May 1968. 50 
pages. (Available from University Mi- 
crofilms, Inc., 300 N. Zeeb Rd., Ann 
Arbor, Mich. 48106.) 

“Evaluative Criteria for Vocational 
Technical Programs.” Harris W. Reynolds, 
et al. Bureau of Curriculum Planning and 
School Evaluation, Pennsylvania State De- 
partment of Public Instruction, Harris- 
burg. 1967. 135 pages. (ERIC # ED 022 
861. HC: $5.48, MF: 750.) 

“A Status Study of High School Gradu- 
ates from an Area Occupational Program,” 
Board of Cooperative Educational Ser- 
vices, First Supervisory District, Erie 
County, New York. June 1969. (Available 
from Thomas E. Smolinski, Administrative 
Assistant, Board of Cooperative Educa- 
tional Services, First Supervisory District, 
Erie County, 99 Aero Dr., Buffalo, N.Y. 
14225.) 

“Speeches Presented at the National 
Conference on Evaluating Vocational and 



Technical Education Programs (Atlantic 
City, N.J., Oct. 6-9, 1968).” Harry F. 
Davis, et al. October 1968. 63 pages. 
(ERIC # VT 008 509. MF available in 
VT-ERIC set.) 

“Evaluation of the Project In-School 
Youth Work Training Program for Four- 
teen and Fifteen Year Old Youth.” Pro- 
gram Evaluation Section, Detroit Public 
Schools, Michigan. January 1968. 25 
pages. (ERIC # ED 026 501. HC: $1.35, 
MF: 250.) 

“Job Training. Research Report Number 
Four.” Manpower Research Council, Mil- 
waukee, Wis. 1967. 10 pages. (ERIC # 
ED 025 635. HC: 600, MF: 250.) 

“Format and Criteria for Analysis of 
State Agencies for Vocational-Technical 
Education.” Oregon State System of High- 
er Education, Monmouth. Sept. 15, 1968. 
80 pages. (ERIC # ED 029 954. HC: 
$4.10, MF: 500.) 

“On the Way to Work: Profiles of 
Significant Schools.” Lewy Olfson and 
Jerome W. Harris. Educational Facilities 
Laboratories, New York. 48 pages. (Avail- 
able without charge from Educational Fa- 
cilities Laboratories, 477 Madison Ave., 
New York, N.Y. 10022.) 

“Manpower Research Projects Spon- 
sored by the U.S. Department of Labor, 
Manpower Administration Through June 
30, 1969.” U.S. Department of Labor, 
Manpower Administration, Washington, 
D.C. 1969. 296 pages. (Order from Man- 
power Administration.) 

“Occupational Licensing and the Supply 
of Nonprofessional Manpower. Manpower 
Research Monograph No. 11.” U.S. De- 
partment of Labor, Manpower Administra- 
tion, Washington, D.C. 1969. 57 pages. 
( Available Xrom U.S. Government Printing 
Office. Price: 600.) 

‘The Bridge Between Man and His 
Work.” Milton E. Larson and Duane L. 
Blake. Colorado State University, Fort 
Collins, Colo. October 1968. 108 pages. 
(See future issue of RIE for ordering 
information.) 

“Effective Assessment in Education with 
Traditional Records and Concepts.” Jeffer- 
¥ son N. Eastmond and Charles M. 
Armstrong. Operation PEP: A State-wide 
Project to Prepare Educational Planners 
for California. December 1968. 67 pages. 
(See future issue of RIE for availability.) 

“Emerging Designs of Assessment in 
Education.” Jefferson N. Eastmond and 
Charles M. Armstrong. Operation PEP: A 
State-wide Project to Prepare Educational 
Planners for California. December 1968. 
75 pages. (See future issue of RIE for 
availability.) 

“The Oregon Planning-Programming- 
Budgeting-Systems Institute.” Harold V. 
McAbee. Teaching Research Division, 
Oregon State System of Higher Education. 
Monmouth, Ore. Dec. 31, 1968. 112 pages. 
(ERIC # ED 030 958. HC: $5.80, MF: 
500.) 

“Workshop on Planning, Implementing, 
and Evaluating Balanced Programs in Dis- 
tributive Education.” Gary R. Smith. De- 
partment of Business Education, Utah 
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atate University, Logan, Utah. 84321. May 
1969. 101 pages. (See future issue of R1E 
for ordering information.) 

“National Institutes on Innovative Cur- 
riculums in Vocational-Technical Educa- 
tion: Final Report.” Hilding E. Nelson. 
Pennsylvania State University, University 
Park, Pa. August 1969. 289 pages. (See 
Feb. 1970 issue of RIE for ordering in- 
formation.) 

“Progress in Education Through Re- 
search, Development, Demonstration, Dis- 
semination, Training: Fiscal Year 1968 
Annual Report, Cooperative Research.” 
U.S. Office of Education, Bureau of Re- 
search. 1969. 54 pages. (Available from 
the U.S. Government Printing Office. Cata- 
log No. FS 5.212.12043. Price: 600.) 

“The Implications of Vocational De- 
velopment on High School Level Vocation- 
al-Technical Education: Final Report.” 
Karl Dutt. Vocational-Technical School, 
Eastern Northampton County, Easton, Pa. 
July 30, 1968. 133 pages. (Order from 
Robert A. Nagle, Director, Vocational- 
Technical School, Eastern Northampton 
County, R.D. 1, Kesslersville Rd., Easton, 
Pa. 18042. Price: $2.50 ERIC # ED 
031 582. HC: $7.40, MF: 75*.) 

“Manpower Research: Inventory for 

Fiscal Year 1968.” Office of Education, 
U.S. Department of Health, Education, 
and Welfare, Washington, D.C. 1969, 153 
pages. (Available from U.S. Government 
Printing Office. Catalog No. FS 5.212.- 
12036-68. Price: $1.75.) 

“Recommended Standards for Teacher 
Education.” Evaluative Criteria Study 
Committee, American Association of Col- 
leges for Teacher Education, Washington, 
D.C. November 1969. 22 pages. (Available 
from American Association of Colleges for 
Teacher Education, One Dupont Circle, 
Washington, D.C. 20036. Price: $1.00.) 

“The Advisory Committee and Voca- 
tional Education.” American Vocational 
Association, Washington, D.C. August 
1969. 52 pages. (Available from American 
Vocational Association, 1510 H St., N.W., 
Washington, D.C. 20005. Price: $1.25.) 

“Industry and Vocational-Technical Ed- 
ucation.” Samuel M. Burt. 1967. (Avail- 
able from McGraw-Hill Book Co., 330 W. 
42nd St., New York, N.Y. 10036. Price: 
$12.50.) 

“The Role of the Advisory Committee 
in Occupational Education in the Junior 
College.” Albert J. Reindeau. The Ameri- 
can Association of Junior Colleges, Wash- 
ington, D.C. 1967. (Available from the 
American Association of Junior Colleges, 



1315-16th St., N.W., Washington, D.C. 
20036. Price: $1.50.) 

“The Advisory Committee Member.” 
The W. E. Upjohn Institute for Employ- 
ment Research, Washington, D.C. August 
1969. (Single copies available free from 
Samuel M. Burt, The W. E. Upjohn Insti- 
tute for Employment Research, 1101-17th 
St., N.W, Washington, D.C. 20036.) 

“Analytical Potential of the Current 
Population Survey for Manpower and Em- 
ployment Research.” J. E. Morton. The W. 
E. Upjohn Institute for Employment Re- 
search, Washington, D.C. December 1965. 
71 pages. (Single copies available free 
from Samuel M. Burt, The W. E, Upjohn 
Institute for Employment Research, 1101 
17th St., N.W., Washington, D.C. 20036.) 

“Education and Training for the World 
of Work: A Vocational Education Pro- 
gram for the State of Michigan.” Harold 
T. Smith. The W. E. Upjohn Institute for 
Employment Research, Washington, D.C. 
July 1963. 165 pages. (Single copies avail- 
able free from Samuel M. Burt, The W. E. 
Upjohn Institute for Employment Re- 
search, 1101-17th St., N.W., Washington, 
D.C. 20036.) 

“The Impact of Technological Change: 
The American Experience” William Ha- 
ber, et al. The W. E. Upjohn Institute for 
Employment Research, Washington, D.C. 
September 1963. 62 pages. (Single copies 
available free from Samuel M. Burt, The 
W. E. Upjohn Institute for Employment 
Research, 1101-17th St., N.W., Washing- 
ton, D.C. 20036.) 

* “The Mission of Manpower Policy.” E. 
Wight Bakke. The W. E. Upjohn Institute 
for Employment Research, Washington, 
D.C. April 1969. 126 pages. (Single copies 
available free from Samuel M. Burt, The 
W. E Upjohn Institute for Employment 
Research, 1101-17th St., N.W., Washing- 
ton, D.C. 20036.) 

“The Role of the United States Employ- 
ment Service in a Changing Economy.” 
William Haber and Daniel H. Kruger. The 
W. E. Upjohn Institute for Employment 
Research, Washington, D.C. February 
1964. 122 pages. (Single copies available 
free from Samuel M. Burt, The W. E. 
Upjohn Institute for Employment Re- 
search, 1101-17th St., N.W., Washington, 
D.C. 20036.) 

“The State Advisory Councils on Voca- 
tional Education.” The W. E. Upjohn In- 
stitute for Employment Research, Wash- 
ington, D.C. 1969. (Single copies available 
free from Samuel M. Burt, The W. E 
Upjohn Institute for Employment Re- 



search, 1101-17th St., N.W., Washington, 
D.C. 20036.) 

“Evaluation in Vocational Education. 
Research Summary,” California Coordinat- 
ing Unit for Occupational Research and 
Development, Sacramento. 1967. 81 pages. 
(ERIC # ED 025 587. HC: $4.15, MF: 
500.) 

DOCUMENT SOURCES 

The material reported on in Research 
Visibility may be obtained from several 
sources. The source of each publication is 
indicated in each entry. The key to the 
abbreviations used there and instructions 
for obtaining the publications are given 
below: 

CFSTI — Clearinghouse for Federal Sci- 
entific and Technical Information, Spring- 
field, Virginia 22151. Copies of reports 
with this symbol may be purchased for 
$3 each (paper) or 65 cents (micro- 
fiche). Send remittance with order directly 
to the Clearinghouse and specify the ac- 
cession number (AD or PB plus a 6-digit 
number) given in the listing. 

ERIC — Educational Resources Informa- 
tion Center, EDRS, c/o NCR Co., 4936 
Fairmont Ave., Bethesda, Maryland 
20014. Copies are priced according to the 
number of pages. The MF price in the 
listing is for microfiche; the HC price is 
for paper copies. Send remittance with 
order directly to ERIC-EDRS and specify 
the accession number (ED plus a 6-digit 
number) given in the listing. How to Use 
ERIC, a recent brochure prepared by the 
Office of Education, is available from the 
Superintendent of Documents, Govern- 
ment Printing Office, Washington, D.C. 
20402; the catalog number is FA 5.212: 
12037-A; price: 30 cents.. 

GPO — Government Printing Office. Send 
orders directly to Superintendent of 
Documents, U.S. Government Printing 
Office, Washington, D. C. 20402, with 
remittance for specified amount. 

MA — Manpower Administration. Single 
copies free upon request to U.S. Depart- 
ment of Labor, Manpower Administra- 
tion, Associate Manpower Administrator, 
Washington, D. C. 20210. 

OTHER SOURCES— Where indicated the 
publication may be obtained directly from 
the publisher at the listed price. 



Research Visibility is a research project of the American Voca- 
tional Association. The purpose is to give visibility to significant 
research: experimental, demonstration and pilot programs; upgrad- 
ing institutes, seminars and workshops; and other leadership devel- 
opment activities for teachers, supervisors and administrators. The 
Research Visibility report synthesizes important projects which 
have been reviewed, selected and analyzed for their value to voca- 
tional, technical and practical arts educators, guidance personnel, 
and other leaders in education, manpower and related fields. A 
composite bibliography of significant research and development 
materials is included. 



The project is cooperatively financed by the American Voca- 
tional Association and a Vocational Education Act of 1963 grant 
(OEG 2-7-070633, project 7-0633; “Synthesis and Application of 
Research Findings in Vocational Education”). 

George L. Brandon, professor in residence (Pennsylvania State 
University) is editor of Research Visibility. He is assisted in the 
preparation of these reports by Research Assistant Marsha Golden 
v of the AVA headquarters staff. 

As Research Visibility is prepared under a U. S. Office of Educa- 
tion grant, it is not included in the American Vocational Journal 
copyright. 
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